Artificial intelligence script tool

ABSTRACT

Systems and methods to create content for interactive synthetic characters are provided. In some embodiments, a conversation editor may be configured to create a traversable script for an interactive synthetic character by receiving conversation rules from a user. These rules can be used to match words or phrases that a user speaks or types, or to monitor for a physical movement of the user or synthetic character. Each rule can include responses to be performed by the interactive synthetic character. Examples of responses include producing audible or textual speech for the synthetic character, performing animations, playing sound effects, retrieving data, and the like. A traversable script can be generated from the conversation rules that when executed by the synthetic character allows for the dynamic interactions. In some embodiments, the traversable script can be navigated by a state engine using navigational directives associated with the conversation rules.

TECHNICAL FIELD

Various embodiments of the present invention generally relate tocreating content for interactive synthetic characters. Morespecifically, various embodiments of the present invention relate toartificial intelligence (AI) script tools.

BACKGROUND

Toys have been around for thousands of years. Egyptian, Grecian, andRoman children played with toys that were made from stone, pottery, wax,wood, and other primitive materials. More recently, toys have also beenmade of newer materials such as plastics. These toys, however, werestatic and children were left to use their imagination in forminganimations or personalities for the toys. Other toys have includedmechanical features that allowed for simple mechanical movements or forthe recitation of a word or phrase when the child pulled a string orpressed a button.

With the proliferation of computers, actuators, and processingtechnology, interactive toys and computer games have become more common.These toys are capable of sensing the environment, making decisions, andinteracting with children. However, many of the toys only provide for alimited set of simple linear interactions. Creating more sophisticatedcontent for these toys and games is still difficult as there are manypotential inputs, each potentially requiring a different response.

Creating systems that can take these inputs and make decisions, reason,evolve, communicate, and manipulate objects is widely studied inbranches of computer science and robotics. While some current toys havemore interactive features, these toys still lack various personalitytraits found in humans. Creating a synthetic character having variouspersonality traits is even more difficult. Traditional tools forcreating scripts and content are too simplistic to allow for theefficient creation of complex interactive content. For example, commonscript writing tools are often linear and do not facilitate dynamicinteractions. As such, there are a number of challenges andinefficiencies found in traditional tools for creating content forartificial intelligence systems such as toys and games.

SUMMARY

Systems and methods are described for creating interactive syntheticcharacters using an artificial intelligence scripting tool. In someembodiments, a method includes displaying a conversation editor on adisplay device. The conversation editor may be configured to create atraversable script for an interactive synthetic character. A set ofconversation rules can be received from a user. In some embodiments,these rules can be guided by the conversation editor. The conversationrules can include multi-way communications between one or moreinteracting entities (e.g., other toys, children, etc.)

In accordance with various embodiments, each conversation rule caninclude one or more responses, which can include actions to be performedby the interactive synthetic character. The responses can include, forexample, audible or written words for the synthetic character to speak,performing one or more animations, playing one or more sound effects,retrieving data from one or more data sources, and the like. Inaddition, in some embodiments, various categories and/or age ranges maybe assigned to the conversation rules allowing different responsesdepending on the age of the end user.

A traversable script can be generated from the set of conversationrules. When executed by the synthetic character, the script allows fordynamic interactions that can depend on multiple variables and/or changeover time. In some embodiments, the traversable script can be navigatedby a state engine using one or more navigational directives associatedwith the conversation rules. Once created, the script can be stored in adatabase which can be accessed by various toys and/or programs.

Various embodiments of the present invention provide for acomputer-implemented method for developing content for an interactivesynthetic character. In accordance with some embodiments, a userinterface screen can be displayed on a terminal (e.g., computer, mobiledevice, etc.). The user interface screen can include a conversation ruleeditor for creating a conversation. A first conversation rule to bematched with a user input (e.g., movements, speech patterns,interaction, etc.) can be received from a user and displayed on the userinterface screen. In some embodiments, a second conversation rule basedon the first conversation rule may be dynamically populated on the userinterface screen. In other embodiments, the user may enter the secondconversation rule. The editor can also allow the user to associate anage or age range, category, navigational directives, time-based rules,and/or other features for creating an interactive experience.

In some embodiments, the user interface screen can include a simulatorallowing the user to navigate the conversation created through aninteractive chat. This simulator may also provide capabilities thatallow the user to debug the current conversation, such as visuallystepping through each rule and response, placing breakpoints at certainpoints in the conversation, or forcing the conversation down a specificpath.

Embodiments of the present invention also include computer-readablestorage media containing sets of instructions to cause one or moreprocessors to perform the methods, variations of the methods, and otheroperations described herein.

Various embodiments of the present invention include a system comprisinga display device, an input/output device, a memory, and a processor. Theprocessor can be in communication with the display input/output deviceand operable to execute instructions stored in memory. In someembodiments, the processor executable instructions can cause theprocessor to communicate display data to the display input/output deviceto cause a graphical user interface to be displayed on the displaydevice. The graphical user interface may include an interactive scripteditor through which a set of customized rules and responses can beentered by a user. The interactive script editor can be used to visuallyindicate the relationship between the set of customized rules, eachhaving a response to be performed by the interactive synthetic characteror an environmental stimulus observed by the interactive syntheticcharacter. Each response to be performed by the interactive syntheticcharacter may be visually associated with a corresponding customizedrule with an environmental stimulus (e.g., data inputs, environmentobservations, or interactions with interactive synthetic character) thattriggers the response.

Some embodiments of the present invention provide for a script writingapplication configured to present conversation rules in a graphical userinterface window. Each conversation rule can be associated with aresponse (e.g., producing audible or textual speech, playing a mediaclip, starting an animation, etc.) to be performed by the syntheticcharacter. The graphical user interface window can include multiplevisual representations of the same conversation. For example, in onerepresentation, the conversation rules may be presented hierarchically.In another representation, a dialog simulator capable of using a stateengine to navigate the conversation rules is presented. The scriptwriting application may also include a suggestion engine configured toreceive the conversation rules and present a suggestion for furtherconversation rules.

While multiple embodiments are disclosed, still other embodiments of thepresent invention will become apparent to those skilled in the art fromthe following detailed description, which shows and describesillustrative embodiments of the invention. As will be realized, theinvention is capable of modifications in various aspects, all withoutdeparting from the scope of the present invention. Accordingly, thedrawings and detailed description are to be regarded as illustrative innature and not restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention will be described and explainedthrough the use of the accompanying drawings in which:

FIG. 1 illustrates an example of a computing environment for creatingscripts for an interactive synthetic character in which some embodimentsof the present invention may be utilized;

FIG. 2 is a screenshot of an exemplary script editor in accordance withone or more embodiments of the present invention;

FIG. 3 is a block diagram illustrating exemplary components for anartificial intelligence script writing tool in accordance with variousembodiments of the present invention;

FIG. 4 is a flow chart illustrating an exemplary set of operations forcreating an interactive experience in accordance with some embodimentsof the present invention;

FIG. 5 is a screenshot of an exemplary script editor for creating dialogin accordance with one or more embodiments of the present invention;

FIG. 6 is a screenshot of an exemplary tree editor in accordance withvarious embodiments of the present invention;

FIG. 7 is a screenshot of an exemplary tree editor tool creating ananimated dialog in accordance with some embodiments of the presentinvention;

FIG. 8 is a flow chart illustrating an exemplary set of operations forgenerating a traversable script in accordance with some embodiments ofthe present invention;

FIGS. 9A and 9B are screenshots of exemplary conversation editorscreating an animated dialog in accordance with some embodiments of thepresent invention;

FIGS. 10A and 10B are screenshots of exemplary synonym and fillerwindows in accordance with some embodiments of the present invention;

FIGS. 11A and 11B are screenshots of exemplary editors for creatingcharacter metadata and managing recorded content in accordance with someembodiments of the present invention; and

FIG. 12 illustrates an example of a computer system with which someembodiments of the present invention may be utilized.

The drawings have not necessarily been drawn to scale. For example, thedimensions of some of the elements in the figures may be expanded orreduced to help improve the understanding of the embodiments of thepresent invention. Similarly, some components and/or operations may beseparated into different blocks or combined into a single block for thepurposes of discussion of some of the embodiments of the presentinvention. Moreover, while the invention is amenable to variousmodifications and alternative forms, specific embodiments have beenshown by way of example in the drawings and are described in detailbelow. The intention, however, is not to limit the invention to theparticular embodiments described. On the contrary, the invention isintended to cover all modifications, equivalents, and alternativesfalling within the scope of the invention as defined by the appendedclaims.

DETAILED DESCRIPTION

Various embodiments of the present invention generally relate tocreating content for interactive synthetic characters. Morespecifically, various embodiments of the present invention relate tosystems and methods for an artificial intelligence scripting tool. Thescripting tool allows for the creators of content to more easily producehierarchical interactions to effectively emulate various human traitsand abilities (e.g., communication, movements, knowledge, etc.) insynthetic characters. As a result, the interactive synthetic characterbecomes more interesting to end users.

In accordance with some embodiments of the present invention, thescripting tool can include various editors, widgets, modules, andfeatures to aid the user in creating the interactive content. Thesetools can be used for creating hierarchical scripts having differentstates that can be traversed depending on different conditions that arepresent. Various engines and models can be used to combine the availableinformation, including uncertain and/or incomplete information, anddetermine how to traverse the script. For example, various deterministicand probabilistic methods (e.g., Bayesian networks, Markov Chains, andKalman filters) may be used. In addition, neural network and fuzzy logiccan be used in some embodiments.

In accordance with some embodiments, the scripting tool can include atree editor that provides a “tree” view of a hierarchical conversation.For example, the editor can allow for multiple inputs such as the usersaying “Hello, how are you?” and “hi.” Depending on the input, differentresponses can be created. For example, in the case of “hi” a response of“hello there!” may be used. In the case of “Hello, how are you?” a moreelaborate conversation can be created by asking the user how they areand then recognize various responses such as “good,” “bad,” or afallback response that will match anything else (to give some kind ofresponse in the cases when we don't understand what the user said).

In some embodiments, the scripting tool allows for key words to beselected from the phrases supplied. The AI system or character can thenlook for these key words in the speech of a user of the AI system orcharacter. This allows the creative writers to write out actual phrasesand then just specify the key words that are used for the patternrecognition. The remaining words in the phrases can be completelyignored or otherwise deemphasized. For example, if only the words “love”and “you” are emphasized, then the system will recognize any phrase fromthe user that uses those words in that order, such as “oh hi there Ireally love all that you are.” This offers a useful technique to allowthe creative user to specify pattern matching for an AI system.

Some embodiments include a script editor that can be used to edit thesame underlying data using a different visual and interactive mechanism.The script editor can allow for a top-down display of dialog from thetop of the screen down through each of the conversation threads. At eachvertical level multiple options may be presented, i.e., the differenttracks the conversation could take. One advantage of the script editoris that the editor may produce a linear looking script from top tobottom of the screen, and the dialog boxes can slide left and right tolet the user choose different tracks down the hierarchical conversation.Thus presenting a more linear view through a hierarchical dataset thatis more familiar to creative workers.

While, for convenience, embodiments of the present invention aredescribed with reference to interactive synthetic characters for toysand games, embodiments of the present invention are equally applicableto various other AI systems with business, military, educational, and/orother applications. The techniques introduced here can be embodied asspecial-purpose hardware (e.g., circuitry), or as programmable circuitryappropriately programmed with software and/or firmware, or as acombination of special-purpose and programmable circuitry. Hence,embodiments may include a machine-readable medium having stored thereoninstructions which may be used to program a computer (or otherelectronic devices) to perform a process. The machine-readable mediummay include, but is not limited to, floppy diskettes, optical disks,compact disc read-only memories (CD-ROMs), and magneto-optical disks,read-only memories (ROMs), random access memories (RAMs), erasableprogrammable read-only memories (EPROMs), electrically erasableprogrammable read-only memories (EEPROMs), magnetic or optical cards,flash memory, or other type of media/machine-readable medium suitablefor storing electronic instructions.

Terminology

Brief definitions of terms, abbreviations, and phrases used throughoutthis application are given below.

The terms “connected” or “coupled” and related terms are used in anoperational sense and are not necessarily limited to a direct physicalconnection or coupling. Thus, for example, two devices may be coupleddirectly, or via one or more intermediary channels or devices. Asanother example, devices may be coupled in such a way that informationcan be passed there between, while not sharing any physical connectionwith one another. Based on the disclosure provided herein, one ofordinary skill in the art will appreciate a variety of ways in whichconnection or coupling exists in accordance with the aforementioneddefinition.

The phrases “in some embodiments,” “according to various embodiments,”“in the embodiments shown,” “in other embodiments,” and the likegenerally mean the particular feature, structure, or characteristicfollowing the phrase is included in at least one embodiment of thepresent invention, and may be included in more than one embodiment ofthe present invention. In addition, such phrases do not necessarilyrefer to the same embodiments or to different embodiments.

If the specification states a component or feature “may,” “can,”“could,” or “might” be included or have a characteristic, thatparticular component or feature is not required to be included or havethe characteristic.

The term “module” refers broadly to software, hardware, or firmware (orany combination thereof) components. Modules are typically functionalcomponents that can generate useful data or other output using specifiedinput(s). A module may or may not be self-contained. An applicationprogram (also called an “application”) may include one or more modules,or a module can include one or more application programs.

General Description

FIG. 1 illustrates an example of a computing environment 100 forcreating scripts for an interactive synthetic character in which someembodiments of the present invention may be utilized. The embodimentsillustrated in FIG. 1 show multiple clients 110 a-110 n running scriptwriting applications 120 a-120 n capable of creating customized contentfor interactive synthetic characters. Clients 110 a-110 n may be webbrowsers, applications, or systems capable of using network 130 foraccessing artificial intelligence (AI) server 140. AI server 140 may berunning server side application 150 which is communicably coupled to ascript database 160 and a sound database 170. Server side application150 may also be used to facilitate some or all of the processingnecessary for script writing application 120 a-120 n. In addition,server side application 150 may host additional subscription basedcomponents to enhance the features within script writing application 120a-120 n.

Script database 160 may be used to store the content created by scriptwriting application 120 a-120 n. Various toys, games, or systems canretrieve the content from script database 160 via network 130. Sounddatabase 170 stores recordings (e.g., media clips, recordings of actorsreading various phrases or dialog portions, or sound effects). Thecontent stored in script database 160 can link to one or more of theserecordings or may include a copy.

Network 130 can be any group of interconnected devices capable ofexchanging information. In some embodiments, network 130 may be as fewas several personal computers on a Local Area Network (LAN) or as largeas the Internet. In some cases, network 130 may be comprised of multiplenetworks (private and/or public), even multiple heterogeneous networks,such as one or more border networks, voice networks, broadband networks,service provider networks, Internet Service Provider (ISP) networks,and/or Public Switched Telephone Networks (PSTNs), interconnected viagateways operable to facilitate communications between and among thevarious networks.

FIG. 2 is a screenshot of an exemplary script editor 200 in accordancewith one or more embodiments of the present invention. Script editor 200may be a desktop application or a cloud computing application. Variousembodiments of script editor 200 allow a user to visually craft theconversational content for a suite of characters. To this end theapplication can include one or more of the following functionalities: 1)deep topic-based conversations (support for nested rules and responses,or rejoinders); 2) flexible rules for matching a range of user inputs(e.g., “I love you” matches “hey I really love you man”); 3)differentiation between user questions and statements; 4) handlenegatives in rules, so “I love you” doesn't match “I don't love you”(e.g., exclude “don't”); 5) support age-specific dialogs; 6) supportdifferent toy personalities (e.g., an emotional model, a pirate model, asports model, etc); 7) handle repetition (i.e., the user repeating thesame thing again); 8) support for fallback topics that attempt torecapture control of the conversation, or directed storytelling; 9)support for synonyms or concepts, i.e., “meat” also matches “chicken,”“beef,” or “pork”; 10) support for time-based rules that allow a toy'scharacter to evolve over usage time; 11) support for specifyingresponses to physical gestures as the user moves the toy; 12) supportfor triggering animations or sound effects; 13) management for allphrases that need to be recorded by a voice talent; and/or 14) versioncontrol, including storing the content in an offsite database.

As illustrated in the embodiments shown in FIG. 2, a main window inscript editor 200 can include a conversation rule editor 210, a categorylist 220, and a chat window 230. Conversation rule editor 210 allows auser to create all of the conversation rules and responses for acurrently selected category. Conversation rule editor 210 enables theuser to enter rules to match things the user says, followed by potentialresponses the AI system or character can offer. Each of these responsescan include follow-up rules and responses in order to continue theconversation. The rules are shown in a hierarchical view to representthe various strands of conversation that can be scripted off of a singletopic.

Category list 220 allows all of the content for a single character to besplit across any number of categories, such as introductions, games,stories, math, etc. Chat window 230 allows the user to test out thelatest content by typing words and seeing how the toy would respond withthe given conversation rules. Various buttons can be used to quicklycreate the content. In addition, search box 240 can be used to searchacross some or all of the categories to find specific interactions.Script editor 200 may not be used to script all content. For example, insome embodiments, some content can be scripted directly using anunderlying storage format, such as XML.

FIG. 3 is a block diagram 300 illustrating exemplary components for anartificial intelligence script writing tool in accordance with variousembodiments of the present invention. As illustrated in FIG. 3, user 310(e.g., an engineer, script writer, novelist, author, or artist) canaccess the AI scripting tool through a graphical user interface 320. Thescripting tool can have access to various features that allow for theuser to more easily create the content. Conversation rule module 330 anda response module 340 can allow the user of the script tool to createcustomized conversation rules or to select from a set of pre-programmedrules. For example, a conversation rule module 330 and a response module340 can be used to allow the user of the scripting tool to create one ormore actions in the synthetic character in response to a set ofconditions, responses, or inputs that have been detected.

In some embodiments, character module 350 can provide a guide to theuser of the scripting tool in creating different types of characters orspecific content. For example, if the user is creating a pirate themedcharacter, character module 350 can provide templates or guidesregarding the conversation style, flow, and direction. In some cases,one or more sound effects (e.g., media clips, recorded phrases, etc.)can be retrieved from sound effect database 360. This can be used toprovide examples to the user of the types of content that can becreated. In addition, the user of the scripting tool may be able toreuse media clips that have already been created. For educationalcharacters, a specific set of educational content may be needed orrequired (e.g., by a third party) to be included content for thesynthetic character. Graphical user interface 320 can also provide avisual indication of which content has been included and which contentstill needs to be included.

Suggestion module 370 can provide a suggested conversational rule to theuser of the scripting tool through the graphical user interface 320.Suggestion module 370 can have input from character module 350 orinclude any content already created in the scripting tool (e.g., one ormore of the previous conversation rules). Suggestions can also bederived from mining the data of previous user interactions with the AIsystem. In addition, in some cases, the scripting tool can allow for theuser to provide an outline for the content flow or specific contentpoints within a conversation. These can also be supplied as inputs tosuggestion module 370. Using one or more of these inputs or information,suggestion module 370 can generate a suggested conversational rule ortemplate which can be presented to the user of the scripting tool. Theuser may ignore, select, or edit the suggested conversational rule ortemplate.

Once the user has completed generating the conversation rules, scriptgenerator 380 can convert the rules into a script that can be followedby a synthetic character. These scripts can be stored in script database390. The scripts created by script generator 380 can have multiplestates which associated responses. A set of conditions or navigationaldirectives are associated with each state. In order to transition ornavigate from one state to another, the navigational directives must besatisfied. Script generator 380 can provide for various consistencychecks. For example, script generator 380 can check that no state withinthe script is isolated from the others (i.e., it will never be reachedduring use of the script). If this occurs, it can be flagged to the user310 of the scripting tool.

FIG. 4 is a flow chart illustrating an exemplary set of operations 400for creating an interactive experience in accordance with someembodiments of the present invention. The operations illustrated in FIG.4 can be performed by one or more hardware components, processors,engines, or modules disclosed herein. For example, one or more of theoperations may be performed by suggestion module 370.

During display operation 410, a graphical user interface screen with ascript editor can be displayed on a display device. Instructions arereceived from a user to create a conversation rule during receivingoperation 420. Upon receiving the rule, a second rule can be dynamicallysuggested during suggestion operation 430. Many different factors and/orinputs may be used in determining the conversational rule to besuggested. Examples include, but are not limited to, age range of a userof the synthetic character, character type, content type, previousconversation rules, capabilities of the synthetic character, specificcontent points, content requirements, inputs collected from earlier userinteractions with the AI system, and/or other inputs or factors. Duringediting operation 440, the user can edit the conversation rule asdesired.

FIG. 5 is a screenshot of an exemplary script editor 500 for creatingdialog in accordance with one or more embodiments of the presentinvention. As illustrated in FIG. 5, the script editor 500 includes aconversation rule editor that offers a number of columns to customizehow rules are matched or when responses may be used. In the embodimentsillustrated in FIG. 5, script editor 500 provides a visual andinteractive mechanism for creating the content. There is a top-downdisplay of dialog from the top of the screen down through each of theconversation threads. At each vertical level we show all the optionsavailable, i.e., the different tracks that the conversation could take.

In this example, the user has selected the line “I'm really sorry tohear that” (in the fourth row), and the system shows (e.g., highlights,colors, or otherwise emphasizes) all of the dialog entries that wouldtake the user to that statement. One of the advantages of this tool isthat the tool can make a linear-looking script from top to bottom of thescreen, and slide dialog boxes left and right to let the user chosedifferent tracks down the hierarchical conversation. It may also alignall of the rules and responses along that path such that they arestacked vertically on top of each other.

FIG. 6 is a screenshot of an exemplary tree editor 600 in accordancewith various embodiments of the present invention. Various embodimentsof the scripting tool can include tree editor 600 that provides a “tree”view of a hierarchical conversation. For example, the editor can allowfor multiple inputs such as the user saying “Hello, how are you?” and“hi.” Depending on the input, different responses can be created. Forexample, in the case of “hi” a response of “hello there!” may be used.In the case of “Hello, how are you?” a more elaborate conversation canbe created by asking the user how they are and then recognize variousresponses such as “good,” “bad,” or a fallback response that will matchanything else (to give some kind of response in the cases when we don'tunderstand what the user said).

In some embodiments, key words can be selected from the phrasessupplied. The synthetic character generated by the AI systems can thenlook for these key words in what the user says. This type of key wordselection allows the creative writers to write out actual phrases andthen just specify the key words that are used for the patternrecognition and ignore or deemphasize the remaining words. For example,if only the words “love” and “you” are emphasized, then the system willrecognize any phrase from the user that uses those words in that order,such as “oh hi there I really love all that you are.” This offers auseful technique to allow the creative user to specify pattern matchingfor an AI system.

FIG. 7 is a screenshot of an exemplary tree editor tool 700 creating ananimated dialog in accordance with some embodiments of the presentinvention. The tree editor tool 700 illustrated in FIG. 7 show someadditional lines for performing an action in the application, playing ananimation on the screen, or playing a sound sample. As such, variousembodiments of the present invention allow for all types of content tobe scripted and in many cases the content can include not only dialog,but an entire multimedia experience.

FIG. 8 is a flowchart illustrating an exemplary set of operations 800for generating a traversable script in accordance with some embodimentsof the present invention. One or more of these operations for generatinga traversable script may be performed by a processor, module, and/orcomponent such as script generator 380. During receiving operation 810,a set of conversational rules are received from the user. Theconversational rules define different states having responses (e.g.,speech, play media clip, animate, etc.) and conditions (or navigationaldirectives) for moving between the states.

Determination operation 820 determines the set of navigationaldirectives. From these, a traversable script is generated during scriptgeneration operation 830. Determination operation 840 determines whetherany updates are needed. For example, the script can be reviewed todetermine if a set of required content has been included. In othercases, the script can be reviewed to ensure consistency with a specificcharacter type or age group. Still yet, determination operation 850 canalso determine if there are any problems with reaching one or morestates within the script. If any updates are needed, then, determinationoperation 840 branches to request operation 850 where a request isgenerated for the user to update the conversational rules. Ifdetermination operation 840 determines that no update is needed, thendetermination operation 840 branches to storage operation 860 where thescript is store in a database.

FIGS. 9A and 9B are screenshots of exemplary conversation editorscreating an animated dialog in accordance with some embodiments of thepresent invention. As illustrated in these embodiments, the conversationrule editor can offer a number of columns to customize how rules arematched or when responses may be used. For example, the user can specifyusing a specific response for users of a certain age, or provide aresponse for a specific toy personality (mean, nice, obnoxious, etc.).

FIGS. 10A and 10B are screenshots of exemplary synonym and fillerwindows in accordance with some embodiments of the present invention.The synonyms window in FIG. 10A allows the user to specify all thesynonyms (or concepts) for words that can be matched within rules. Oneadvantage of this feature is that it allows the user to write a singlerule that can match many different variations. Synonyms can be reused inevery rule using a special character (e.g., ˜). In the exampleillustrated the text “˜meat” in a rule will also match “beef,” “pork,”“lamb,” “chicken,” as well as “meat” itself.

The conversation filler window allows the user to create various fillerwords or phrases that the synthetic character can use at its discretionto work around technical limitations like network lag, robotic speechsynthesis, not hearing the user respond, etc. Some of the fillercategories may be defined by the scripting tool and the user simplyprovides a set of possible things to say for each category. In otherembodiments, customized categories may be created by the user.

FIGS. 11A and 11B are screenshots of exemplary editors creatingcharacter metadata and managing recorded content in accordance with someembodiments of the present invention. FIG. 11A illustrates a characterproperty editor that allows the user to specify various metadatadescribing the character. This editor can also be used to specify thedefault state for the synthetic character, such as its initialpersonality or the default age range that it will customize content for(until it knows the user's actual age).

FIG. 11B illustrates a pre-recorded content editor that can be used tomanage pre-recorded audio content for all the things a syntheticcharacter can say. The pre-recorded content editor may be able to searchand find all of the responses that need to be recorded. In someembodiments, the pre-recorded content editor can display a record listof all the responses to be recorded, all those that have already beenrecorded, and a way to detect phrases that may be duplicates and thatcould be merged to reduce the number of recordings.

Additional functionality, perhaps in a different editor, may be used tosimplify the process of recording content, cutting it into individualMP3 files, cropping, changing bit rate, and associating each file withthe appropriate responses. In many cases, the various scripting toolsdescribed here may not be responsible for all the scripted dialogcontent. Other elements created outside of the scripting tools mightinclude: 1) automatically generated rules, such as from a list of yes/noquestions; 2) logic puzzles that require coding skills, such as mathgames or guess-the-number-I'm-thinking-of; and/or 3) games that involvetables of data that can be downloaded, such as knowing all the capitalsof the world. The scripting tools, in accordance with one or moreembodiments, may provide an interface for inserting, editing, orinterfacing with outside content. In some embodiments, the scriptingtools could provide access to the set of transcribed voice recordingsthat we gather from users, to suggest new topics of conversation.

Exemplary Computer System Overview

Embodiments of the present invention include various steps andoperations, which have been described above. A variety of these stepsand operations may be performed by hardware components or may beembodied in machine-executable instructions, which may be used to causea general-purpose or special-purpose processor programmed with theinstructions to perform the steps. Alternatively, the steps may beperformed by a combination of hardware, software, and/or firmware. Assuch, FIG. 12 is an example of a computer system 1200 with whichembodiments of the present invention may be utilized. According to thepresent example, the computer system includes a bus 1205, at least oneprocessor 1210, at least one communication port 1215, a main memory1220, a removable storage media 1225, a read only memory 1230, and amass storage 1235.

Processor(s) 1210 can be any known processor, such as, but not limitedto, an Intel® Itanium® or Itanium 2® processor(s), or AMD® Opteron® orAthlon MP® processor(s), or Motorola® lines of processors. Communicationport(s) 1215 can be any of an RS-232 port for use with a modem-baseddialup connection, a 10/100 Ethernet port, or a Gigabit port usingcopper or fiber. Communication port(s) 1215 may be chosen depending on anetwork such a Local Area Network (LAN), Wide Area Network (WAN), or anynetwork to which the computer system 1200 connects.

Main memory 1220 can be Random Access Memory (RAM), or any other dynamicstorage device(s) commonly known in the art. Read only memory 1230 canbe any static storage device(s) such as Programmable Read Only Memory(PROM) chips for storing static information such as instructions forprocessor 1210.

Mass storage device 1235 can be used to store information andinstructions. For example, hard disks such as the Adaptec® family ofSCSI drives, an optical disc, an array of disks such as RAID, such asthe Adaptec family of RAID drives, or any other mass storage devices maybe used.

Bus 1205 communicatively couples processor(s) 1210 with the othermemory, storage and communication blocks. Bus 1205 can be a PCI/PCI-X orSCSI based system bus depending on the storage devices used.

Removable storage media 1225 can be any kind of external hard-drives,floppy drives, IOMEGA® Zip Drives, Compact Disc-Read Only Memory(CD-ROM), Compact Disc-Re-Writable (CD-RW), Digital Video Disk-Read OnlyMemory (DVD-ROM).

The components described above are meant to exemplify some types ofpossibilities. In no way should the aforementioned examples limit thescope of the invention, as they are only exemplary embodiments.

In conclusion, the present invention provides novel systems, methods,and arrangements for creating customized interactive content forsynthetic characters. While detailed descriptions of one or moreembodiments of the invention have been given above, variousalternatives, modifications, and equivalents will be apparent to thoseskilled in the art without varying from the spirit of the invention. Forexample, while the embodiments described above refer to particularfeatures, the scope of this invention also includes embodiments havingdifferent combinations of features and embodiments that do not includeall of the described features. Accordingly, the scope of the presentinvention is intended to embrace all such alternatives, modifications,and variations as fall within the scope of the claims, together with allequivalents thereof. Therefore, the above description should not betaken as limiting the scope of the invention, which is defined by theappended claims.

What is claimed is:
 1. A system comprising: a display device; an inputdevice; and a memory that includes instructions for creating acustomized script for a synthetic character, wherein the instructions,when executed by a processor, cause the processor to: present agraphical user interface comprising a plurality of columns on thedisplay device, wherein each column of the plurality of columns includesa graphical representation of a user input and a graphicalrepresentation of a synthetic character response corresponding to analternate thread of a conversation, wherein the user input and thesynthetic character response in each column corresponds to aconversation rule for the synthetic character, the conversation ruleindicating to the processor how the conversation will flow under certainconditions, and wherein each column of the plurality of columns ispresented horizontally in succession to visually illustrate alternatethreads of the conversation; receive an input indicative of user inputprovided via the input device; and cause at least one column of theplurality of columns to be adjusted to reflect a customization to aconversation rule associated with the at least one column in response tothe input.
 2. The system of claim 1, wherein the conversation rulereflects an environmental stimulus, wherein the environmental stimulusincludes data inputs, environment observations, or interactions with thesynthetic character.
 3. The system of claim 2, wherein the data inputsinclude current weather conditions gathered from a remote source, timeof day, day of the week, location, age of a child, or previous patternsof interaction.
 4. The system of claim 2, wherein the environmentobservations include a number of observed voices, current noise level,objects present, or detection of a second synthetic character.
 5. Thesystem of claim 1, wherein at least one synthetic character responseincludes a sound effect.
 6. The system of claim 5, wherein the soundeffect includes a voice-simulated reading of text within one of a set ofcustomized responses, a media clip, or a live speaker.
 7. The system ofclaim 1, wherein the instructions further cause the processor to: permittext appearing in at least one of the graphical representations of theuser inputs to be modified to reflect a key word that will be used forpattern recognition.
 8. The system of claim 1, wherein at least onesynthetic character response includes an animation.
 9. Acomputer-implemented method for developing content for an interactivesynthetic character, the method comprising: causing display of agraphical user interface comprising a plurality of columns, wherein eachcolumn of the plurality of columns includes a graphical representationof a user input and a graphical representation of a synthetic characterresponse corresponding to an alternate thread of a conversation, whereinthe user input and the synthetic character response in each columncorresponds to one or more conversation rules for the interactivesynthetic character, and wherein each column of the plurality of columnsis presented horizontally in succession to visually illustrate alternatethreads of the conversation; receiving an input indicative of user inputprovided by an operator; causing at least one column of the plurality ofcolumns to be adjusted to reflect a customization to a conversation rulespecified by the input, the conversation rule being associated with theat least one column; and dynamically adjusting a column of the pluralityof columns to reflect an additional conversation rule based upon theinput.
 10. The computer-implemented method of claim 9, wherein theadditional conversation rule includes a response to be performed by theinteractive synthetic character.
 11. The computer-implemented method ofclaim 9, wherein at least one conversation rule of the one or moreconversation rules includes an age association.
 12. Thecomputer-implemented method of claim 9, wherein at least oneconversation rule of the one or more conversation rules includes anenvironmental stimulus.
 13. The computer-implemented method of claim 12,wherein the environmental stimulus includes speech observed by theinteractive synthetic character.
 14. The computer-implemented method ofclaim 9, wherein at least one conversation rule of the one or moreconversation rules includes a navigational directive indicatingconditions upon which a state engine will move from one conversationrule to another conversation rule.
 15. The computer-implemented methodof claim 14, wherein the navigational directive includes a time-basedconversation rule allowing the state engine to navigate to differentconversation rules over time.
 16. The computer-implemented method ofclaim 9, further comprising: modifying, based on the input, at least oneof the graphical representations of the user inputs to reflect a keyword that will be used for pattern recognition.
 17. Thecomputer-implemented method of claim 9, wherein the graphical userinterface includes a simulator input allowing the operator to navigateconversation content created for the interactive synthetic character.18. A computer-implemented method comprising: displaying a conversationeditor configured to create a traversable script for an interactivesynthetic character; causing the conversation editor to present agraphical user interface comprising a plurality of columns, each of theplurality of columns depicting one or more graphical representations ofuser inputs and one or more graphical representations of syntheticcharacter responses in an alternate thread of a conversation, the userinputs and synthetic character responses in each column corresponding toone or more conversation rules for the interactive synthetic character,each column of the plurality of columns presented horizontally insuccession to visually illustrate alternate threads of the conversation;receiving a set of conversation rules from a user, wherein eachconversation rule includes one or more responses to be performed by theinteractive synthetic character; generating the traversable script fromthe set of conversation rules, wherein the traversable script can benavigated by a state engine; and storing the traversable script in adatabase.
 19. The method of claim 18, wherein the set of conversationrules includes multi-way communications between more than oneinteracting entity.
 20. The method of claim 18, further comprisingassociating a navigational directive with each conversation ruleindicating conditions when the state engine will transition to anotherconversation rule.
 21. The method of claim 18, further comprisingdetermining when one or more responses include phrases to be recorded bya voice talent.
 22. The method of claim 18, further comprisingassociating a category with the traversable script.
 23. The method ofclaim 18, further comprising associating an age range with each of theconversation rules or responses.
 24. The method of claim 18, wherein theone or more responses to be performed by the interactive syntheticcharacter include producing audible or textual speech for theinteractive synthetic character, performing one or more animations, orplaying one or more sound effects.
 25. A non-transitorycomputer-readable medium comprising instructions configured to cause acomputer system to perform a method comprising: displaying, on a displaydevice, a graphical user interface comprising a plurality of columns,wherein each column of the plurality of columns includes one or moregraphical representations of user inputs and one or more graphicalrepresentations of synthetic character responses in an alternate threadof a conversation, wherein the user inputs and synthetic characterresponses in each column correspond to one or more conversation rulesfor a synthetic character, and wherein each column of the plurality ofcolumns is presented horizontally in succession to visually illustratealternate threads of the conversation; receiving, from an operator ofthe computer system, an input; causing at least one column of theplurality of columns to be adjusted to reflect a customization to aconversation rule associated with the at least one column in response tothe input; and dynamically adjusting a column of the plurality ofcolumns to reflect an additional conversation rule based upon the input.26. The non-transitory computer-readable medium of claim 25, wherein atleast one conversation rule of the conversation rules reflects anenvironmental stimulus, wherein the environmental stimulus includes datainputs, environment observations, or interactions with the syntheticcharacter.
 27. The non-transitory computer-readable medium of claim 26,wherein the data inputs include current weather conditions gathered froma remote source, time of day, day of the week, location, age of a child,or previous patterns of interaction.
 28. The non-transitorycomputer-readable medium of claim 26, wherein the environmentobservations include a number of observed voices, current noise level,objects present, or detection of a second interactive syntheticcharacter.
 29. The non-transitory computer-readable medium of claim 25,wherein at least one synthetic character response includes a soundeffect.
 30. The non-transitory computer-readable medium of claim 29,wherein the sound effect includes a voice-simulated reading of textwithin one of the set of customized responses, a media clip, or a livespeaker.
 31. The non-transitory computer-readable medium of claim 25,wherein the method further comprises: permitting text appearing in atleast one of the graphical representations of the user inputs to bemodified to reflect a key word that will be used for patternrecognition.
 32. The non-transitory computer-readable medium of claim25, wherein at least one synthetic character response includes ananimation.
 33. The non-transitory computer-readable medium of claim 25,wherein each of the plurality of columns represents a potential linearconversational exchange between a user and the synthetic character. 34.A system comprising: a display device; an input device; and a memorythat includes instructions for creating a traversable script for aninteractive synthetic character, wherein the instructions, when executedby a processor, cause the processor to: present a graphical userinterface comprising a plurality of columns on the display device,wherein each column of the plurality of columns includes one or moregraphical representations of user inputs and one or more graphicalrepresentations of synthetic character responses, the user inputs beingvocalizations made by a user and the synthetic character responses beingvocalizations, animations, or both made by the interactive syntheticcharacter, wherein each of the plurality of columns represents adistinct an alternate thread of a conversation, wherein the syntheticcharacter responses in each column are chosen in accordance with one ormore conversation rules for the interactive synthetic character, andwherein each column of the plurality of columns is presentedhorizontally in succession to visually illustrate alternate threads ofthe conversation; recognize a keyword within at least one user input,wherein the keyword is used to identify an appropriate syntheticcharacter response for the at least one user input; visually distinguishthe keyword from other words in the at least one user input; receive aninput via the input device that modifies one of the one or moreconversation rules; and cause at least one of the synthetic characterresponses in one of the plurality of columns to be dynamically adjustedto reflect the modification of the conversation rule.